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ABSTRACT 

The problem of synchronization and detection of random pulse-position-modulation 
(PPM) sequences is investigated under the assumption of perfect slot synchronization. 
Maximum-likelihood PPM symbol synchronization and receiver algorithms are derived 
that make decisions based both on soft as well as hard data; these algorithms are seen 
to be easily implement-able. We derive bounds on the symbol error probability as well 
as the probability of false synchronization that indicate the existence of a rather severe 
performance floor, which can easily be the limiting factor in the overall system performance. 
The performance floor is inherent in the PPM format and random data and becomes more 
serious as the PPM alphabet size Q is increased. A way to eliminate the performance floor 
is suggested by inserting “special" PPM symbols in the random data stream. 
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I. INTRODUCTION 


Pulse-position-modulation is a modulation format known to be optimal in various 
ways for the direct-detection optical channel (see for example [1,2,3]). Under Q-ary PPM, 
information is contained in the position of a signal pulse in only one of Q subintervals, 
known as slots, dividing the symbol interval. 

When pulse-position-modulation is used in communication systems, the practice is to 
first achieve slot synchronization before attempting higher order synchronization and sym- 
bol decoding. Slot synchronization is usually obtained by using a tracking-loop as recently 
studied, for example, by Chen and Gardner [4] and Ling and Gagliardi [5]. Although op- 
timal (in the maximum-likelihood as well as the mean-square-error sense) PPM slot and 
symbol synchronizers have also been recently derived [6,7], they have the disadvantage of 
being more complicated to implement compared to the tracking-loop synchronizers that 
are well understood and easy to implement. The difficulty in implementing the optimal 
synchronizers stems from the need to record the exact arrival time of each detected photon, 
a task that may be difficult to achieve at high data rates and large signal intensities. A 
further reason that makes tracking-loops more desirable for slot synchronization is that 
they have been shown to result in receivers with symbol error probability performance 
within a fraction of a dB from the perfect slot synchronization case at reasonable signal 
levels [4:. We point out here that the authors in [4 are investigating the effects of slot 
synchronization errors only and thus assume that once slot synchronization is achieved, 
symbol synchronization is automatically obtained. This is equivalent to assuming that the 
only ambiguity in symbol synchronization is the ambiguity in slot synchronization, which 
in practice is not a valid assumption since slot synchronization does not imply symbol 
synchronization. 

In this paper vre investigate the problem of PPM symbol synchronization and decoding 
under the assumption of perfect slot synchronization. For Q-ary PPM, the existence 
of slot synchronization still leaves unresolved a 0-ary ambiguity as to the position of 
the PPM symbols. However, in contrast to the slot synchronization case where system 
error probability degrades gracefully with the slot synchronization error, the effect of non- 


perfect symbol synchronization is catastrophic. One can easily see that a sequence of N 
random PPM symbols decoded under non-perfect symbol synchronization will result in all 
N symbols being decoded erroneously, irrespective of the size of the error. This observation 
leads to the conclusion that the real bottleneck in system performance is due to the symbol 
synchronization subsystem which we investigate in the sequel. 

In section II we investigate and characterize the synchronization properties of random 
PPM sequences. In section III, we derive ML symbol synchronization algorithms for the 
PPM, optical Poisson channel, both from soft as well as hard data. Here we also derive a 
bound on the synchronization probability, valid at high signal-to-noise levels. Section IV 
contains the derivation of optimal receivers that make sequence decisions in the absence 
of symbol synchronization. Also included in this section is a bound on the minimum 
achievable symbol error probability. Finally, we conclude with section V. 

II. SYNCHRONIZ ABILITY OF PPM SEQUENCES 

In this section we investigate the synchronization properties of random PPM se- 
quences. Broadly speaking, these are properties associated with our ability to identify 
uniquely (or not) the location of PPM symbols within a sequence of such symbols when 
only slot boundaries are known. Before we proceed further, we introduce some definitions 
and terminology to establish a common ground and facilitate later analysis. 

De finition 1: A binary sequence of Q digits is said to satisfy the PPM constraint and, 
thus, be a Q-ary PPM symbol only if exactly one out of the Q digits is a “one”; Q will be 
referred to as the PPM alphabet size. 

It is easily seen from the above definition that for a given sequence length N there are 
Q A valid PPM sequences and that they can be thought of as a subset of the 2 A£ ^ binary 
sequences of length NQ. 

Definition 2: A sequence of binary digits is said to be a valid Q-ary PPM sequence if, 
starting from the first bit, every consecutive subsequence in it of length Q is a Q-ary PPM 
symbol. 


3 


Definition 3: Consider a Q-ary PPM sequence ( N + 1) symbols long ((N+1)Q slots) 
and a sliding window of NQ slots applied to the PPM sequence. For a given slot shift j , 
j = 0, 1, 2 , (Q — 1), we will refer to the binary sequence within the window as a PPM 
binary subsequence at (slot shift) j. It is obvious from the definition that a PPM binary 
subsequence is not necessarily a PPM sequence, i.e., not all consecutive binary sequences of 
length Q within the window are PPM symbols. Also obvious is the fact that, if j = 0, then 
the PPM binary subsequence is a PPM sequence that coincides with the first N symbols 
of the original sequence. Similarly, for j = Q the PPM binary subsequence is a PPM 
sequence that coincides with the last N symbols in the original sequence. Notice that slot 
shift j = Q does not need to be investigated in searching for symbol locations since it is 
equivalent to j = 0. 

Given the above definitions, we are now ready to derive some results. As a first step in 
characterizing the synchronization properties of random PPM sequences, we are interested 
in the following problem. 

Consider a Q-ary PPM sequence of length (N 4- 1) symbols, chosen at random from 
the set of Q (N+1 * possible PPM sequences, and a given slot shift j . We are interested in the 
probability that exactly K out of the N symbols within the PPM binary subsequence at 
slot shift j are Q-ary PPM symbols. The usefulness of this quantity should be apparent in 
the context of symbol synchronization when only slot synchronization is present. Leaving 
the details of the derivation for Appendix A, we can show that this probability, defined by 
P{K\ j.Q,N), is given by 


P(K- j. Q, N)= {0'/Q) (A " +1) (l - j/Q) (X ~ K) 


(i -j/Q) {K+1) U/Q) (N ~ K) }. 


(i) 

It is obvious from the above expression that P{K: j. Q . A*) = P(K\ Q — j , Q , A T ), which 
implies that P(A; j, Q, N) is symmetric with respect to forward and backward slot 
shifts from the correct slot for symbol synchronization. Another observation that can be 
readily made is that the above probability is a convex function of j, achieving a minimum 
at j = Qj 2 when Q is even, as is usually the case. This implies that slots closer to the 
correct symbol synchronization slot have a higher probability of being erroneously chosen 
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for symbol synchronization than slots further away. 

Of special interest is the case when K = A’, P(N\ j, Q. N), i.e., the probability that 
the PPM binary subsequence at slot shift j is a PPM sequence. Easily obtained from (1), 
it is 

P(JV; j, Q, N) = (j/Q) N+1 + (1 (2) 

Equation (2) implies that there is a nonzero probability of identifying symbol locations 
erroneously, even in the absence of noise. A bound on the probability of erroneous symbol 
synchronization is derived in the next section. 

In passing, we note that P(K; j , Q, N) can be expressed as the ratio of the number 
of PPM sequences that, for a given j, result in exactly K PPM symbols within the PPM 
binary subsequence at j, to the total number of distinct PPM sequences of length (N + 1). 
Denoting the number of sequences resulting in K matches by D(K; j , Q, A T ), we then 
have 

D(K; j, Q , N) = Q< n +» P(K ; j, <?, JV). (3) 

We now turn our attention to the implications of (1) on symbol synchronization in 
the limit as the sequence length N tends to infinity. It is readily seen that for any fixed 
A.P(A; j, Q. A) — > 0 as N — » oo, which implies that the fraction of sequences that 
result in exact ly K matches diminishes with N. However, the more important quantity is 
the probability that the number of matches K will exceed a given number r. Specifically, 
of interest is the smallest value of r such that the probability of more than r matches goes 
to zero as A" — > oo, for all slot shifts j = 1.2, • ■ ■ .(Q — 1). Obviously, this minimum value 
of r is a function of the PPM modulation format and the alphabet size Q only; moreover, 
the smaller it is, the better the symbol synchronizer will be able to perform in the presence 
of noise for large N. 

The following proposotion establishes the range of values of r such that the probability 
of more t han r symbol matches tends to zero with A*. 

Proposition 1: Let Pr[K > r; j, Q, N\ be the probability that the number of symbol 
matches A within a PPM binary subsequence at slot shift j exceeds r for a given Q and 
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N. Then, if (r/JV) > (1 - 1/Q) 


lim Pr[K > r; j, Q. A r ] = 0 

N => oc ' 


(4) 


for all slot shifts j. Conversely, for ( r/N ) < (1 — 1/Q). there is some slot shift j such that 


lim Pr\K > r; ji, Q. N] = 1. 

A" => oc 


(5) 


Proof: We first prove (4). Using the Chernoff bound we have 


Pr[A' > r; j , Q, iV] < exp(-sr )<£($; j, Q, N) s > 0, 


( 6 ) 


where 

N 

4>(s; j, Q, N) = ^ exp{sm)P{m; j , Q, N) 

171 = 0 

= 07<?) [(j/<?) c + (1 - UQ)f + (1 - J/0)[(1 - j/Qy * (7) 

is the characteristic function of the random variable A”, easily obtained from (1). In order 
to guarantee that (4) holds for all j, it is enough to make sure that (4) holds for the j 
that makes the right-hand side of (6) largest. From the easily established convexity of 
0{s\ j. Q. .V) and its symmetry around j = Qf 2, we conclude that the maximum occurs 
at one of the boundaries, say j = 1. Letting p = 1/Q we have 

<p{s; j , Q, N) < (p{s ; 1, Q, N) = p[p( s - (1 - p)] A + (1 - p) [(1 - p)e s +p] N . (8) 

Observing now that the second term in (8) is the larger term we can further bound the 
right-hand side of (8) by twice this term: combining with the bound in (6), we get 

Pr'K > r\ j , Q, iV] < 2(1 — p)exp(— sr) [(1 — p)e s — p}^ . s > 0. (9) 

Further tightening the bound with respect to s. we finally obtain for (r /N) > (1-1 IQ) 

0 < Pr[K > r; j. Q, N[ < 2(1 — p)exp { — A*[£’(r/A' r |!( 1 — p)) - hb(r/N)}} . (10) 
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In (10) E{q\\h] and hb(x) are the cross entropy (inaccuracy) and binary entropy functions 
defined respectively by 


E[q\\h] = —q ln(h) - (l — q)ln(l - h) (11) 

h b( x) = — x ln(r) - (1 — x) In (1 - x) (12) 

for some probabilities q. h and x. It is well known that the inaccuracy is always greater 
than or equal to the entropy (see for example [8]), which implies that the exponent in (10) 
is non-positive. Thus, in the region ( r/N ) > (1 — 1 jQ) where the bound is valid, taking 
the limit as JV — > oc yields (4). 

We now turn our attention to the converse in (5). Since we only need to show con- 
vergence to unity for some j, we choose j = (Q — 1) (an educated choice). We start by 
deriving the following Chernoff bound 


Pr[K < r; j. Q, JV ] < exp( -sr )<£(.*; j, Q , JV), s < 0. (13) 

Following arguments paralleling those above we obtain for j = (Q — 1) and {r/N) < 

(l-i /Q) 

Pr K < r; j. Q. N < 2(1 - 1 /Q)exp{- N{E(r/N^(l - 1/C?)) - h b (r/N)}} (14) 

where we have used the fact that Pr\K < r; j , Q. N < Pr K < r; j, Q. N . The 

condition (r/N) < (1 — 1 / C? ) gives a range of values of r for which the bound is valid 

and is derived from the condition s < 0. Taking limits as N — ► oc in (14) we obtain 
Pr K < r\ j , Q, JV] — * 0 when (r/N) < (1 — 1/Q), which in turn implies (5). This 
completes the proof of the proposition. 

One of the implications of the theorem is that for large (theoretically infinite) JV, the 
fraction of symbols within any PPM binary subsequence that are valid PPM symbols can 
be quaranteed to be less than (1 - 1 /Q). In other words, the number of PPM symbol 
matches K for any slot shift j = 1, 2, • ,(Q — 1), satisfies, for large JV 

K < (1 - 1 /Q)N 
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( 15 ) 



which implies that the number of mismatched symbols, call it d, satisfies 

d = (N — K) > NjQ. (16) 

From (16) we can see that for large N, the minimum number of symbol mismatches for 
any slot shift j , call it d m ; n , is 

d mia = N/Q. (17) 

The quantity d m ; n can easily be paralleled to the minimum distance of a block code, only 
now d m is the minimum average distance between random PPM sequences for any slot 
shift j = 1, 2, ••*,((? — 1) away from the correct synchronization slot. Clearly, the larger 
d m in is, the better the symbol synchronizer will be able to identify symbol locations in the 
presence of noise. Another obvious observation from (17) is that d mm is monotonically 
decreasing with the PPM alphabet size Q, which in turn implies that synchronization 
performance deteriorates as Q is increased. This observation was made also in [4] and [7] 
for the slot and PPM symbol synchronization problems respectively. Later in this paper we 
relate the minimum distance d m ; n for random PPM sequences to the smallest achievable 
synchronization error probability. 

In concluding this section, we note that the minimum average distance d min derived 
above is for random PPM sequences, which indicates the existence of sequences with larger 
dmin- The problem of designing such sequences is briefly investigated in the next section. 

We next turn our attention to the problem of deriving optimal PPM symbol synchro- 
nization when slot synchronization is present. 

III. ML SYNCHRONIZATION 

Our application area here is the direct-detection optical Poisson channel. For this 
channel, it can be easily established that when only slot synchronization is present, the 
sufficient statistic is the number of photons (events) observed in each slot interval of T' 
seconds. For the Poisson direct-detection channel, the number of counts observed in dis- 
tinct slot intervals are independent Poisson random variables with intensity (A, + A n ) if a 
signal pulse is present in the corresponding slot and A n otherwise; A., and A„ are known 
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as the signal and noise intensities respectively. We derive synchronization algorithms from 
two kinds of observations, defined in the sequel. 


a) Soft-data observations: 

In deriving the ML synchronization algorithm here, we assume that the receiver has 
available an observation vector R = (A'i, A' 2 , •••, Kq , •••, Knq ) with elements being 
the number of counts in NQ observed, consecutive slots. W r e will refer to the data in R as 
soft-data. Within this observation window there are (N + 1) symbols, two of them at the 
boundaries partially contained. The problem is to estimate the location of symbols within 
the observation interval. 


Denoting by m the variable associated with the start of a symbol within the first Q 
slots in the observation interval, a. ML synchronizer implements the following 

(18) 


max Y' Pr(R/ m, d) 

0<m<(Q — 1 ) ' 

d 

where d — (dj, d 2 , •••, ••• , d/vg) is the random modulation vector of intensities 

within the observation interval. In writing (18), we assume that all modulation vectors 
are equiprobable. Following the general approach described in [6, 7] and making the 
assumption that the first partially contained symbol within the observation interval is a 
continuation of the last partially contained symbol, we obtain as the likelihood statistic 

L s {m) = ln ex P[ /n (- Y ) A ’(<-DQ+j+mi| • (19) 

I 11 (19), X = (1 + As/A n ) and K, is the number of counts observed in the i — ih slot in the 
observation interval. The indexes in (19) are interpreted modulo QN to account for our 
approximation above. We note here that this approximation was not necessary in deriving 
the ML synchronizer but was made to reduce complexity at no practical performance loss 
for values of of N greater than four [6. 7|. 

A further approximation to (19) can be obtained by using only the largest term in the 
sum over j to yield 


.v 


L'(m) = V A' (l _j 


)Q~ji-rrn ■ 


( 20 ) 


1= ] 
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We will refer to (20) in the sequel as the max-rule. In (20), j, is the value of j. i <j<Q, 
that, for a given i and m maximizes 

Computer simulation results comparing the probability of correct synchronization, 
P cs , for the synchronizers in (19) and (20) are reported in Figures 1,2 and 3 for different 
values of Q and N. These results indicate that the much simpler synchronizer in (20) 
performs practically as well as the significantly more complicated one in (19). Also ev- 
ident from the graphs is that for the same signal energy per slot A 3 T' , synchronization 
performance degrades with Q and improves with N, as predicted in the previous section. 
Finally, it is clear from the figures that a performance floor exists which is practically in 
effect for signal levels of about A ,T' = 10.0. This error-floor is investigated later in this 
section. 


We now turn our attention to deriving synchronization algorithms when the receiver 
observations consist of hard-data, obtained from the soft-data vector R by making hard 
decisions in each slot interval. 


b) H ard-data observations 

Here we assume that the receiver has available the binary vector of observations X = 
(rj. J 2 • a" < 5 , •••, a\vc?) obtained by making hard-decisions on the vector R. By 

this we mean that the receiver looks at A',, i = 1, 2, •••, NQ, and decides that x, = 1 
or x, = 0 according to whether a signal pulse is detected (a “one”) or not (a “zero”) 
respectively; i.e., 

/ P - AM 1 

> 1 . ( 21 ) 

=0 


TV [“one” /A, = A',] * i_1 
Pr[“zero”/A, = A',] < 


In (21), R , is the (Poisson) random variable associateed with the number of counts in the 
t’-t-h slot and A, are the observed counts. The above test can easily be shown to reduce to 

Z, = ] 


Ki < 7 


( 22 ) 


where the optimal threshold ~) is given by 

A r T' + In (Q - 1 ) 
1 ln( 1 + As/' An ) 


( 23 ) 
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It is obvious that further processing on the vector X to derive synchronization and perform 
decoding is much easier to implement compared to the soft-data case. Another advantage of 
algorithms derived from hard-data is that their structure does not depend on the complete 
statistics of the channel. The above reasons were partly why hard-data was employed in 


[9], 


Before we proceed with the derivation of the ML synchronization algorithm, we intro- 
duce the following quantities: 


Pr X t = 0/d, = 0] = Pr[K, < 7 jd, = 0] = Poo (24) 

Pr[X, = 1/di = 1] = Pr\Ki > 1 /d, = 1] = P„. 

Then 

Pr[Xi-i /dj = 0 ] = (1 — Poo ) (25) 

Pr[Xi = 0/d, = 1] = (1 — Pn ). 


The above probabilities can be easily precomputed given T', Q and the signal and 
noise intensities A, and \ n respectively. Under the assumption of equiprobable PPM 
symbols, the ML synchronization rule maximizes over 0 < m < (Q — 1) the following 
statistic 


£>(»•) = S Pr i X j'm, d] 

d 

N-i Q Q 

— V] 2 1 Pr i A t Q + j-i- ru = x iQ+j+m /m, d t q+ j^. m = 0] 

i = 0 A- = l i = i 

Pr\XiQ+k+m — XiQ + k + rn / ^ • ^iQ + fc — m = 1] 

A* - 1 Q 

13 ] T Pr[X tQ+J+m — x ,Q-\- j+m / m, diQ-i-j-i- m = 0j 

i =0 j = 1 

^ ^ ' P^l A — X iQ-i- fr + m /w . + — 1 

j P^ [ A tQ+ k 4- m — J j Q-f fc-fm /m , d,Q -i-t-f-ni — Oj 


(26) 


The second equality above is a result of the independence between choice of PPM sym- 
bols. which breaks the expectation over sequences to expectations over individual symbols. 
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The third equality should be self evident. Observing now that the product over all j' s and 
i's of Pr{X lQ+J + m = XiQ+j+ m /m, diQ+j+m = Oj is not a function of m, we can equiva- 


lently maximize, 


L 2 (m ' 


N - 1 

In 


i' = 0 


V / 


iQ+k-t-m 


.*•= 1 


(27) 


where 




Pr[A",Q + fc + m = ZjQ + lc + m/™., d,Q + k + m — 1] 


(28) 


,Q+*+m Pr-^iQ+fc + n, = *iQ+ Jt + m = 0] 

In deriving (27), we have dropped terms not dependent on m and taken the logarithm 
of the resulting expression. Further noting that by multiplying l'iQ + i e+m by any constant 
does not affect the maximization, we finally obtain 


N - 1 


Lh(m) = YL ln 


i = 0 


^ ^ ^iQ + fc-t-m 

Lfc=i 


where 


Pi 




liQ+k + m — rj \ l iQ+k-\-m- 

( I - r'oo ) 

It is clear that l t Q+k+m takes one of two values according to 

f 1, if x t = 1 
* \ C, if x.i = 0, 

where 


(29) 


(23) 


C 


(1 — PlJ )( 1 - Poo' 


(3i; 


(32) 


Pn Poo 

Since for a practical system Pn > (1 — Pn) and Poo > (1 ~ Poo)i it is 0 < C < 1. For a 
good system (P n >> (1 - P n ) and P o0 >> (1 - Poo)) C will be very close to zero and 
exactly zero when either Poo or Pn is unity. In this case, the optimal synchronizer from 
hard data reduces to 


,V-] 


Lh{m ) = ^ In 


t = 0 


V 


iQ — k -t m 


Lfc = l 


(33) 


A situation when P 0 o = 1 arises, for example, when X n = 0 resulting in an erasure 
channel. It is then seen that the optimal synchronization rules for a perfect channel where 
both “zeros” and “ones" are decoded correctly with probability one is the same as that 
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for the erasure channel where only “zeros” are detected correctly all the time. This of 
course does not imply that the performance of the synchronizers for the two channels are 
identical. From the information theory point of view, for both the perfect and the erasure 
channels, it is the presence of a pulse that carries all synchronization information, utilized 
fully by (33). 

In general, for channels with small noise intensities A n and relatively large signal 
intensities A s , (33) can be used as an approximation to (29) to further reduce complexity. 

Having derived optimal synchronization under the assumptions of both soft as well 
as hard-data, we now turn our attention to the investigation of the ultimate performance 
achievable by such synchronizers. 

c) A bound on synchronization probability 

Our interest here is deriving an upper bound to the probability of correct synchro- 
nization, P cl) . It is clear that the synchronization probability is bounded from above by 
the probability that one or more PPM binary subsequences are PPM sequences, in which 
case a random selection must be made. Denoting this random sequence limited probabilit y 
by P r$ i . we have 

Pc, < Pr-sl = Q- {N + 1) Y, r 1 7 ’ ( 34 ) 

' k + 1 

k = 0 

where D k is the number of PPM sequences resulting in exactly k slot shifts for which PPM 
binary subsequences are valid PPM sequences. The probability of k such matches, P m (k ), 
is 

P m (k) = D k -Q- {N+i) . (35) 

Leaving the details for Appendix B, we can derive the following expressions 

D 0 = <? (N41) - 2 (Q - 1) (N+:1) + (Q - 2) ( - V41) (36) 

P m (0) = 1 - 2(1 - 1/<?) (JV ^> + (1 - 2/Q) ( ' v+1) (37) 


j 2. Q — 2 

\ 2{(Q - 1) (A ' +1) - (Q - 2) (A ' +1) - 1], Q > 2 


(38) 


13 



/ 2 -A \ 

Pm ( 1 ) = | 2 |p _ 1 /Q)(W+ 1) _ (1 _ 2/Q) (N+1) - (1/<?) (N+1) ], 

Q = 2 
Q >2. 

(39) 

Dq - i = Q 


(40) 

P m (Q-H=Q~ K . 


(41) 


The derivation of the above equations was obtained by repeated use of the following 
observation. 

Proposition 2: For a given PPM sequence, in order for the PPM binary subsequence at 
j to be a valid PPM sequence it is necessary and sufficient that either all pulses (pulsed 
slots) are before the j- th slot or all after the j-th slot. 

The proof of the above proposition is easily seen by construction. 

We are now ready to derive a bound on the random sequence limited probability P ra i, 
and by extension to the probability of correct synchronization P ca . 

Proposition 3: The following bound on the random sequence limited probability Prsl 

holds for all Q and N 

P ral < 1 - (1 - 1 /Q) (N+1) + ^(1 - 2/Q) (N ^ (42) 

with equality for Q — 2 and Q = 3. 

Proof: The following inequality is obvious 

Q - 2 

Prsl < Pm( 0) + £ Pmd) + £ P m {Q ~ 1 ) + \ ^ P "> ' (' k > ( 43 ) 

~ w ° k=2 

where equality is when Q equals two or three. Using the fact that 
Q - 2 

V P m {k) = 1 - [Pm(0) f Pm(l) -t- P m (Q — l)j (44) 

k = 2 

and the expressions for the various probabilities in equations (37), (39) and (41 ) we obtain 
the required bound. 
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We note that the bound in (42) will be tight for all values of Q when N is sufficiently 
large to make the probability of two or more slot shifts for which PPM binary subsequences 
are PPM sequences negligibly small. This fact is verified in Table 1. where simulation 
results are compared to our bound. 

A lower bound on the probability of erroneous synchronization P ea = (1 — P cs ) is 

Pes > (1 - 1/Q) (N+1) - i(l -2 /<?) ,N+1) (45) 

which is achieved at high signal-to-noise levels and sufficiently large N. It is clear from (45) 
that the error-floor rises with increasing Q and decreasing N as predicted by the decrease 
in d m i n in equation (17). Let us now show that the distance d min enters the bound on 
erroneous synchronization probability in a natural way as N — » oc. For a given d m ; n , we 
have Q = Nfd miIl . Then 



Since the second term above is at least an order of magnitude smaller than the first for 
reasonably large <f m i n ( say d min > 3), we obtain, for very large (theoretically infinite N) 
and reasonably large d m -, n 

P e ,>e~ dmin . (47) 

Equation (47) indicates an exponential decrease in the error-floor w r ith increasing d min . 

As an example of how 7 the bound in (45) can be used in a system design we derive 
next the minimum number of slots that need to be processed in order to quarantee a given 
performance. The number of slots observed, IT — Q(N -t- 1), is a measure of the receiver 
complexity and is an important parameter in practical implementation. We show that the 
following proposition is true. 

Proposition 4 : The smallest number of slots lT m ; n that need to be processed to guarantee 
an error-floor not more than some P e f is 

Ibmin = -2 log 2 (P f /). (48) 
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and is achieved with binary PPM. 

Proof: We have W = Q{N + 1) > 2(A r + 1) with equality iff Q = 2. Further. w T e have 

(1-1/<?) (N+1) - 1 -(l-2/Q) iN+1) = P ef 

which implies {X 4- 1) > — log 2 (P e f) with equality iff Q = 2. Combining the two inequal- 
ities above, we get 

IF > — 2 log 2 (P ef ) 

with equality iff Q = 2. This proves the proposition. 

We end this subsection by noting that the bound in (42) is valid also for the re- 
sults reported in [12] where PPM symbol synchronization is derived in the absence of slot 
synchronization. Next, we investigate ways to remove the error floor predicted above. 

d) Sequence Design 

We start with a definition. 

Definition 4: A PPM sequence will be said to be synchronizable if no PPM binary sub- 
sequence in it is a valid PPM sequence. Equivalently, a PPM sequence is synchronizable 
if each PPM binary subsequence of it contains at least one symbol that is not a PPM 
symbol. 

It is clear from the above definition that symbol locations within synchronizable PPM 
sequences can be uniquely identified in the absence of noise. As we derived earlier, for a 
given Q and N there are Do synchronizable PPM sequences as given by equation (36). 

We are now ready to prove the following propositions. 

Proposition 5: When a synchronizable PPM sequence is inserted in another PPM se- 
quence, the resulting longer sequence is synchronizable. 

Proof: By the definition of a PPM sequence all symbols within it must be PPM symbols. 
However, for any slot shift j = 1, 2, ,{Q — 1), there is at least one symbol in the 

inserted synchronizable sequence that is not a PPM symbol (by definition). Since the 
inserted sequence is a part of the longer sequence, this implies that at least one symbol in 
the longer sequence is not a PPM symbol for all j — 1, 2. ••• , {Q — 1). This implies by 
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definition 4 that the longer sequence is synchronizable, which completes the proof. 
Proposition 6: A Q-ary sequence is synchronizable if and only if it contains both symbols 
1 and Q ; symbol 1 has the pulse in the first slot and symbol Q has the pulse in the Q-th 
slot. 

Proof: a) We first prove the forward statement. If both symbols 1 and Q are in the 
sequence, then there is no slot shift j — 1, 2, • ■ • , (Q — 1) for which all pulses are before 
or afler j. Thus, by proposition 2 no PPM binary subsequence is a PPM sequence and, 
thus, by definition 4 the sequence is synchronizable. 

b) If not both symbols 1 and Q are in the sequence, we distinguish three possibilities: 
only symbol 1 or only symbol Q is present or neither is present . If symbol 1 only is present, 
then the statement “all pulses are before slot (Q — 1)” is true which by proposition 2 it 
implies the sequence is not synchronizable. Similarly, if symbol Q only is present, then 
the statement “all pulses are after slot 1” is true which implies again that the sequence 
is not synchronizable. Finally, if neither symbol is present, both of the above statements 
in quotation marks are true, which again implies the sequence is not synchronizable. This 
completes the proof. 

To facilitate reference in the sequel, we will refer to the pair of symbols 1 and Q as 
the sync hronizable pair . 

It is clear from the above proposition that D 0 in equation (36) gives the number of 
sequences from the set of possible sequences that contain at le; st one synchro- 

nizable pair. Obvious from the proof of the proposition, also, is the fact that it doesn’t 
matter where the two symbols are located within a sequence to make it synchronizable. 
Finally, we observe that the more synchronizable pairs a sequence contains, the better its 
synchronization properties in the presence of noise. 

One way of removing the error-floor predicted by (42) is to periodically insert in 
the random data stream a synchronizable pair. If, for example, a synchronizable pair is 
inserted every L PPM symbols, all PPM sequences of length greater or equal to L will be 
synchronizable according to proposition 5. The efficiency E of such a scheme as measured 
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by the number of information symbols per transmitted symbol will be 

£ = iTi = 1 - 2 - /£ - < 49 > 

which approaches unity as L is increased. It is clear, however, that the smaller L is, 
the better chances for correct synchronization in the presence of noise will be. In cases 
where a special synchronization pattern is inserted in the data stream to facilitate frame 
synchronization (see for example :10, 11, 12]), the extra reduction in efficiency to improve 
symbol synchronization can be avoided by choosing a pattern with as many synchronizable 
pairs as possible. Such a pattern will aid in both symbol as well as frame synchronization 
when they are obtained separately. 

In the next section, we investigate the problem of deciding what the symbols within 
an observation interval are as opposed to where they are which we analyzed above. We do 
this under the assumption of slot synchronization only. 

IV. DETECTABILITY OF PPM SEQUENCES 

a ) M L Receivers: 

In this section we turn our attention to the problem of PPM sequence estimation 
when only slot locations are exactly known. Our observations consist of the vector R = 

( A'j , A *2 , • • • , Kq , • • • , Kjvq ) of slot counts. 

Under the assumption of equiprobable sequences, an optimal receiver is a ML receiver 
that chooses as its sequence estimate the sequence d that maximizes 

Q - 1 

p(R/d) — ^ p(R/d, m )Pr[m ). (50) 

m~0 

In (50), Pr(m) is the a priori probability that the first PPM symbol in the interval [0, QT'\ 
starts at time mT' . Assuming that no a priori knowledge exists, then Pr(m) = 1/Q for all 
m. Using the fact that the elements of R are conditionally independent Poisson random 
variables and dropping terms not dependent on the modulation sequence, we obtain as our 


18 



optimal receiver 


(51) 


N 

ln {\ ) ^ ^ A Ji(d) + m 

i = ] 

In deriving (51) we have assumed that the first symbol in the observation interval is a 
continuation of the last, partially contained symbol. As for the synchronization case, this 
approximation reduces substantially the complexity of the receiver at no practical per- 
formance loss for N greater than about four ill]. To accommodate this approximation, 
indexes in (51) are interpreted modulo QN. The set A is the set of all possible distinct 
Q-ary PPM sequences of length N and J;( d), i = 1,2, • • • , N, is a set of indexes indicat- 
ing the slots within sequence d that contain the pulses. For example, the Q = 4 PPM 
sequence consisting of the A T = 5 symbols {1,3, 3, 4, 2} can be described equivalently by 
= {1,7,11,16,22}. Finally X = (1 — A J( /A n ) is as defined earlier. 

Although each computation of (51) is relatively easy to perform, the complexity of 
the receiver is still overwhelming since Q A statistic need to be evaluated before a decision 
is made. However, following arguments similar to those in [11], we can show that only Q 
of the Q n sequences are most likely to have been sent. Denoting the set of Q candidate 
sequences by A*, the receiver in (51) becomes (with no loss in performance) 

max £(d) . (52) 

d£A‘ 

The set of Q candidate sequences A* is obtain in the following way: 

Step 1: Group the observation vector into Q consecutive slots per symbol and decode it into 
a sequence of N PPM symbols. Store the decoded sequence as a possible candidate. 
Note that decoding the observation vector into PPM symbols is done by choosing the 
largest number of counts in each group of Q slots, which is the optimal st rategy when 
synchronization is present. 


V-i 


max 

d€A 


^(d) = 5] ex P 


m = 0 


Step 2: Cyclically shift the observation vector by one slot to the left, and go back to step 1. 
Repeat until the observation vector is cyclically shifted by (Q — 1) slots. 

The result of the above procedure is Q candidate sequences which are then used 
to evaluate ('( d ) and make a final decision by choosing the largest. The idea behind the 
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tremendous reduction in the number of evaluations of f’(d) is simple: we know that symbols 
start at one of the times mT',m = 0. 1 • • • , [Q - 1 ) corresponding to the start of the first 
Q slots in the observation interval. Thus, by decoding the observation vector for each 
possible m = 0, 1, •••,(£? — 1), we are assured that one of the Q decoded sequences is 
the one we would have obtained have we had perfect synchronization. This implies that, 
limiting our search in the set A* does not increase our error probability, since the best we 
can hope to achieve is the performance of a perfectly synchronized receiver. 

To illustrate the above approach, we take a simple example. 

Example 1: Let Q = 3, N =4 and the observation vector R = (0, 4, 2, 1, 5, 3, 2, 3, 1, 6, 3, 5, ) 
Decoding this vector into a PPM sequence, we obtain do = (2,5,8,10). Cyclically shifting 
R by one slot to the left and decoding we obtain di = (1,4,9,11). Finally shifting by 
another slot we get d 2 = (3,4,8,10). Evaluating (52) using ln{ X) = 1.3 we get f’(do) = 
1.462 x 10 10 , ^(dj) = 1.957 x 10 11 and ^(d 2 ) = 5.335 x 10 10 and thus the decision is 
d = dj = (1,4,9,11). In a practical implementation of (52) only the first (N - 1) symbols 
in the decoded sequence will be retained as valid symbols since the last one is actually 
the concatenation of two partially complete symbols and is likely to be in error. For our 
example above only the subsequence (1.4.9) will be retained. By properly allowing overlap 
between consecutive observation intervals, all symbols are effectively decoded. 

Approximations to (51) can be derived that further reduce complexity. An obvious 
one is to maximize w r ith respect to d £ A* not the sum over all m but only the largest 
term in the sum, i.e. 

N 

max V A' Ji(d)+m . (d ). (53) 

d£ A' 

i—\ 

In (53) m ‘(d) is the value of m — 0. 1. ■ • ■ ,[Q — 1) that maximizes the inside sum in (51) 
for a given d. What we have in effect is a joint estimation of the modulation sequence and 
synchronization, i.e. (53) is equivalent to 

N 

max V A\, i(d)+m . (54) 

d£A”, me'0,(Q-l)j 4 

i = l 

We next turn our attention to the performance achievable by the above receivers. 
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b) A bound on error probability 


As with the synchronization problem, here we are interested in finding a bound on 
the ultimate performance that can be achieved by the receivers described above. 

Our starting point is the observation that when a receiver detects a sequence at the 
wrong location, then the sequence is detected erroneously. This implies that the probability 
of sequence detection P s d is bounded by the probability of correct synchronization P ce , i.e., 
P„d < P C3 , which in turn yields 

Psd < Prsl < 1 - (1 - l/(?) (iV+1) + |(1 - 2/Q) (N+1) . (55) 

We observe that the PPM format imposes a severe error-floor on the sequence detection 
probability when symbol synchronization is absent. 

We now turn our attention to the symbol detection probability P sy d and prove the 
following proposition. 

Proposition 7: The symbol detection probability is bounded by 

P.yd < 1 - (1 - 1/Q) ( V+ " - ^(1 - 2/Q) in+ '\ (56) 

Proof: Letting P sy d be the symbol detection probability in the absence of any channel 
noise, we have P 3y d £ P>yd- We further observe that, in the absence of noise, when a 
sequence error is made (due to wrong synchronization ), all the symbols in a sequence are 
received incorrectly; otherwise, all symbols are received correctly. From this observation 
we infer that P sy d equals the probability of sequence detection in the absence of noise, 
which in turn equals P rs i,i.e., P sy d = Prsl • We thus have P iy d — Prsl which with equation 
(42) imply (56). This completes the proof. 

The symbol error probability floor predicted by (56) in the absence of symbol syn- 
chronization can be very severe, especially for large values of Q. As an example, Q = 256 is 
an alphabet size considered for some applications: if an error-probability floor of at most 
10 _o is required, a simple calculation shows that at least 435,200 slots need to be processed 
(N = 1700) in order to satisfy the performance requirements. 
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V. CONCLUSIONS 


We have considered the problem of synchronization and detection of random PPM 
symbols in the presence of only slot synchronization. In characterizing the synchroniza- 
tion properties of PPM symbols imbedded in long random PPM sequences, we introduced 
the minimum distance d m)n . From our analysis we concluded that synchronization per- 
formance improves with the length of the observed sequence and degrades with increasing 
PPM alphabet size. 

In section III we derived optimal and suboptimal symbol synchronizers and a lower 
bound to the synchronization error probability; the error floor was seen to be due to the 
PPM modulation format . A way to remove the error-floor was suggested which consists of 
inserting periodically in the random data stream a pair of “special’’ symbols. The insertion 
of these symbols may be necessary to remove the error-floor, especially for large values of 
Q where it is most severe. Maximum- likelihood receivers that make sequence decisions in 
the presence of slot synchronization only are derived in section IV as well as bounds to the 
sequence and symbol detection probabilities. We observed here that the symbol detection 
probability is bounded by the probabilit y of correct synchronization. 

Our conclusion is that for channels where the mechanisms that can cause random slot, 
shifts are such that the phase in a given observation interval cannot be reliably predicted 
from previous observation intervals, the symbol error-floor is severe, especially for large Q. 
In these cases, some signal design to eliminate the error-floor is necessary. 
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APPENDIX A 


Derivation of Equation (1) 

For a given alphabet size and sequence length (JV + 1) let Pr \K;j/S\ = i] be the 
probability that K of the N symbols within the PPM binary subsequence at j are PPM 
symbols, given that the first symbol in the sequence is S] = i. i = 1, 2, • • • , Q,. For a given 
j , we distinguish two cases: either i < j or i > j . For i < j, the probability that K of the 
N symbols are PPM symbols is the probability that K of these symbols have pulses in the 
first j slots. Since symbols within a sequence are randomly chosen, the probability that K 
of the N symbols have pulses before or at the j — th slot is ( j/Q) h (1 — j/Q) N ~ h ■ Since 
there are ( ^ ) sets of K symbols we have 

Pr [K\j/Si = tj = (^J(j/Q) h (l - j/Q) N ~ h , i = 1,2, ..,j. (1.4) 

Now, for Q > i > j, in order for K symbol matches to occur it must be that K symbols 
have pulsed slots after the j — th slot, which implies 

Pr [K\ j / S\ = i] = (*yi-j/Q) K U/Q) N ~ K , i = U + 1), 2 (2.4) 

All we need to do now is expectate over all Q first symbols i, all equiprobable. Per- 
forming the expectation yields equation (1). 
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APPENDIX B 


Derivation of Equations (36) -(41) 

We first derive equation (36). Here we are interested in the number Do of sequences 
for which no PPM binary subsequence is a PPM sequence. Our approach is to start 
with the Q(N -!- 1) possible sequences and then subtract all unwanted sequences. Using 
proposition 2. we must subtract all sequences that have all their pulses after the j — fh 
slot for j = 1, 2, ■ - • , (Q — 1 ) and all sequences that have all their pulses before the j — th 
slot, j = 1,2, •••,((? — 1). It is easily seen that there are ( Q — 1 )*^ +1 * of the former and as 
many of the letter; (Q — 2) (A + 1 ^ of these sequences belong to both categories. Subtracting 
2 (Q — l) <;v + 1) from Q^ +i ' 1 and adding (Q — 2) <A+1! to avoid subtracting sequences twice 
yields (36). (37) is obtained by dividing (36) by + 

Let us now compute the number Di of sequences that have exactly one PPM binary 
subsequence which is a PPM sequence at some shift j = 1, 2, • • • , (Q — 1 ). If we let X(j) 
be the number of sequences whose PPM binary subsequence at j is a PPM sequence, we 
have 

Q-i 

D, =£.¥(». (IB) 

1 = 1 

For a given j , X (j ) is the number of all the sequences that have either all pulses before j or 
all after j . It is easily seen that there are j N+1 of the former and (Q — j ) A ' + 1 of the latter. 
From the j" v+1 sequences we must subtract sequences that have all pulses after slot 1 or 
before slot (j — 1) since these are sequences that result in PPM sequence at some slot shift 
i < j ; there are 2{j — 1)^ +1 — (j — 2)' % ^ J such sequences for Q > 2. Similarly, from the 
(Q — j ) A + 1 sequences we must subtract all those that have either all pulses after the (j 4- 1 ) 
slot or all pulses before (Q— 1) ( and after j): there are \2{Q - j — l) Ar+1 — (Q — j — 2) A + 1 
such sequences. Denoting by I\(j) the number of sequences that have exactly one match 
at j and have all pulses before j and by /^(jf ) those that have exactly one match at j and 
all pulses after j, we have for Q > 2. 


/ 0, j = 1 

1 J N+1 - 2 (j - l)* v+1 + (j - 2 ) N+ \j = 2.3. •••,«?- 1 ) 


(2 B) 


h(j) = 
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and 


r (i)= / °,(Q -i) = 1 

2U; \ (<? ~ j) N + 1 — 2(Q — j — 1 ) A+1 + (<? - j - 2) A + 1 . (Q — j) = 2, 3, •■■,((? — 1). 

(3B) 

It is clear that X (j ' = Ii{j) + h(j) and that, X ( j ) = _Y((? — j). Then 

Q - i Q-i 

j=l ( 4 -°) 

= 2[(<?-l) N+1 -((?-2) A ’ +1 -1], Q> 2. 

For the special case <5 = 2 it is easily seen by inspection that £>] = 2 which along 
with (4B) yields (38). Equation (39) is obtained by dividing by Q^ A+1) . 

Finally, to obtain (40) and (41), we observe that in order for all PPM binary subse- 
quences at j — 1, 2, • • • , (Q — 1) to be valid PPM sequences it must be that, all (N + 1) 
symbols in a sequence are the same. Since there are Q such sequences, we obtain (40) from 
which (41) follows. 
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FIGURE captions 


Figure 1: Simulation results for the synchronization probability P cs for Q — 2, N 
5,10. 


Figure 2: Simulation results for the synchronization probability P cs for Q = 8, A 7 


20.40. 


Figure 3: Simulation results for the synchronization probability P C3 for Q = 16, N 
20.40. 


TABLE CAPTIONS 


Table 1: Comparison between simulations and the bound in (42). 



TABLE I. COMPARISON BETWEEN SIMULATIONS 
AND THE BOUND IN (42) 


0=2 Q=4 


N 

SIMULATIONS 

BOUND 

SIMULATIONS 

BOUND 

5 

0.970 

0.969 

0.765 

0.773 

10 

0.999 

0.999 

0.944 

0.944 

15 

1.000 

1.000 

0.986 

0.987 

20 

1.000 

1.000 

0.996 

0.997 

25 

1.000 

1.000 

0.999 

0.999 

30 

1.000 

1.000 

1.000 

1.000 

35 

1.000 

1.000 

1.000 

1.000 

40 

1.000 

1.000 

1.000 

1.000 


Q= 8 



Q=16 

N 

SIMULATIONS 

BOUND 

SIMULATIONS 

BOUND 

5 

0.490 

0.566 

0.270 

0.447 

10 

0.741 

0.756 

0.484 

0.563 

15 

0.872 

0.870 

0.620 

0.665 

20 

0.933 

0.932 

0.720 

0.748 

25 

0.966 

0.965 

0.809 

0.813 

30 

0.982 

0.982 

0.858 

0.862 

35 

0.991 

0.991 

0.897 

0.899 

40 

0.994 

0.995 

0.925 

0.926 
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